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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1. A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible 
for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) has been 
timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 
1.1 14. Applicant's submission filed on 1/30/2008 has been entered. 

2. Claims 1 - 17, 20, 26 - 34, 36 - 40, and 45 - 58 are pending. Claims 18, 19, 21 - 25, 35, 
and 41 - 44 have been cancelled. Claims 54 - 58 are new. Claims 1, 17, 29, and 38 are the 
independent claims. Claims 1, 17, 29, and 38 are the amended claims. Claims 1 - 17, 20, 26 - 
34, 36 - 40, and 45 - 58 have been rejected. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of 
Ibis title, if the differences between the subject matter sought to be patented and the prior art are such that the subject matter 
as a whole would have been obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the maimer in which the invention was made. 



4. Claims 1 - 4, 6, 8, 12, 17, 20, 26, 27, 29 - 31, 38 - 40, 45, 47 - 53, and 58 are rejected 
under 35 U.S.C. 103(a) as being unpatentable over Ohkado (US 2001/0047626 Al) in view of 
Caviedes (US 6,646673 B2). 
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As per independent claims 1 and 29, Ohkado discloses a method of simplifying user 
interaction with one or more real time communication user interfaces by adapting the one or 
more user interfaces to the user's activity level in a computer system that supports real-time 
communication between a user of the computer system and one or more contacts and a computer 
program product comprising one or more computer readable media carrying computer 
executable instructions that implement said method, said method comprising acts of: 

displaying a representation of a user interface for real-time communication, 
the intermediate representation including a text input box and at least a 
portion of a received real-time message ([0017], lines 6 - 9); 
monitoring user interaction with the intermediate representation of the user 
interface ([0007], lines 9 - 1 1 and [0010] - [001 1]); and 
determining a level of user interaction with the intermediate representation of 
the user interface based on monitored user interactions with the user interface 
and automatically adapting the user interface to the user's activity level 
([0015], lines I -4) by performing at least one of: 
o based on the determined level of user interaction, automatically enlarging the 
size of the intermediate representation of the user interface to an enlarged 
representation appropriate for a high determined level of interaction, wherein 
the enlarged representation includes the text input box ([0010] and [0013]); 
and 

o based on the determined level of user interaction, automatically reducing the 
size of the intermediate representation of the user interface to a reduced 
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representation appropriate for a low determined level of interaction ([0011] 
and [0014]). 

Ohkado does not explicitly disclose that, in the step of monitoring, all types of user 
interaction are monitored, wherein the level of user interaction is based on all of these types of 
user interaction over a period of time to produce an overall level of user interaction in which to 
base the automatic adapting. 

Nevertheless, even though it would have been obvious that if Ohkado could monitor one 
type of user interaction over time, Ohkado could also monitor all types of user interaction over a 
period of time, reference is made to the analogous art of Caviedes, which discloses numerous 
types of user interaction that may be monitored over a period of time to determine an "activity 
information" that essentially serves as an overall activity level used to automatically adapt the 
representation of a user interface (column 4, lines 36-45; column 5, lines 10 - 19; and column 
5, line 63 - column 6, line 43). 

Caviedes pertains to the art of groupware systems, distance learning systems, and 
videoconferencing systems that allow multiple users to communicate through video, audio, and 
text (column 1, lines 16-26 and column 3, lines 43 - 50) and Ohkado pertains to the analogous 
art of multiple user communication systems also for allowing a user to communicate through text 
[0004] - [0005]). Therefore, because they both pertain to analogous art, one would look to the 
other for possible improvements upon their invention. Furthermore, Ohkado intends to adapt a 
user interface of a communication system based on monitored user activity ([0008]). Therefore, 
because Caviedes recognizes a deficiency relevant to Ohkado, wherein user interfaces of 
communication systems often do not provide the right level of information to a user for the user 
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to easily interact with the interface (column 1, line 38 - column 2, line 8), it would have been 
obvious to one of ordinary skill in the art at the time of invention to combine Caviedes with 
Ohkado, because the combination would help overcome this deficiency of such communications 
systems by allowing a user interface to be modified in a helpful way based on monitored activity. 

As per independent claims 17 and 38, the claims are sufficiently similar to independent 
claims 1 and 29 and are therefore rejected for the same reasons as disclosed in the rejection of 
claims 1 and 29, supra. 

As per claim 2, and taking into account the rejection of claim 1, Ohkado further 
discloses that the reduced representation includes the text input box ([0017], lines 9-11). 

As per claim 3, and taking into account the rejection of claim 1, Ohkado further 
discloses that the acts of automatically enlarging and reducing the intermediate representation 
of the user interface occur without an explicit input to reduce or enlarge the intermediate 
representation ([0015], lines 1 -4). 

As per claim 4, and taking into account the rejection of claim 1, Ohkado further 
discloses that the enlarged representation corresponds to a maximized state for the user 
interface, and wherein the intermediate representation of the user interface corresponds to a 
minimized state for the user interface ([0010] - [001 1]), wherein the "first size" corresponds to a 
maximized state and the "second size" corresponds to a minimized state. 

As per claim 6, and taking into account the rejection of claim 1, Ohkado further 
discloses that the increased level of interaction comprises one or more of hovering over the 
intermediate representation and clicking a pointing device on the intermediate representation 
([0007], lines 9 -11). 
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As per claim 8, and taking into account the rejection of claim 1, Ohkado further 
discloses that the intermediate representation of the user interface for real-time communication 
is displayed within a desktop bar ([0031] and [0042]). 

As per claim 12, and taking into account the rejection of claim 8, Ohkado further 
discloses that the desktop bar displays one or more representations of one or more other user 
interfaces simultaneously with the intermediate representation of the user interface for real-time 
communication ([0031]), wherein the fact that the representation can be displayed on a title bar 
of an object window means that the title bar would also display representations of the other 
objects, wherein it is inferred that objects may comprise interfaces. 

As per claims 20 and 40, and taking into account the rejection of claims 17 and 38, 
Ohkado further discloses that the step for automatically applying the determined size adjustment 
to the initial representation of the user interface based on the monitored level of user interaction 
occurs without an explicit input to reduce or enlarge the initial representation ([0015], lines 1 - 
4). 

As per claim 26, and taking into account the rejection of claim 17, Ohkado further 

discloses an act of displaying the initial representation of the user interface for real-time 
communication in a desktop bar ([0031] and [0042]). 

As per claim 27, and taking into account the rejection of claim 26, Ohkado further 
discloses that the desktop bar also displays one or more representations of one or more other 
user interfaces ([003 1]), wherein the fact that the representation can be displayed on a title bar of 
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an object window means that the title bar would also display representations of the other objects, 
wherein it is inferred that objects may comprise interfaces. 

As per claim 30, and taking into account the rejection of claim 29, Ohkado further 
discloses the act of automatically reducing the intermediate interface occurs without an explicit 
input to reduce the intermediate representation ([0015], lines 1 -4). 

As per claim 31, and taking into account the rejection of claim 29, Ohkado further 
discloses that the intermediate representation of the user interface corresponds to a minimized 
state for the user interface ([0010] - [0011]), wherein the "first size" corresponds to a 
maximized state and the "second size" corresponds to a minimized state. 

As per claim 39, and taking into account the rejection of claim 38, Ohkado further 
discloses displaying the initial representation of the user interface ([0008]). 

As per claim 45, and taking into account the rejection of claim 38, Ohkado further 
discloses displaying the initial represen tation of the user interface for real-time communication 
in a desktop bar that also displays one or more representations of one or more other user 
interfaces ([0031] and [0042]), wherein the fact that the representation can be displayed on a title 
bar of an object window means that the title bar would also display representations of the other 
objects, wherein it is inferred that objects may comprise interfaces. 

As per claim 47, and taking into account the rejection of claim 17, Caviedes further 
discloses automatically adjusting subsequent representations of the user interface according to a 
periodic interval (column 4, lines 36 - 45). 
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As per claims 48 and 51, and taking into account the rejection of claims 17 and 38, 
Ohkado further discloses that automatically applying the determined size adjustment to the initial 
representation of the user interface comprises enlarging at least a portion of the representation 
of the user interface ([0010]). 

As per claims 49 and 52, and taking into account the rejection of claims 17 and 38, 
Ohkado further discloses that automatically applying the determined size adjustment to the initial 
representation of the user interface comprises reducing at least a portion of the representation of 
the user interface ([001 1]). 

As per claims 50 and 53, and taking into account the rejection of claims 17 and 38, 
Ohkado further discloses that automatically applying the determined size adjustment to the initial 
representation of the user interface comprises maintaining the current size of at least a portion 
of the representation of the user interface (column 17, lines 4-11). 

As per claim 58, and taking into account the rejection of claim 1, Caviedes further 
discloses that the monitored user interaction with the intermediate representation includes two 
or more of the following over the period of time: hovering over the intermediate representation 
with a pointing device, entering text using the intermediate representation, selecting an element 
in the intermediate representation with the pointing device, changing focus to the intermediate 
representation, dragging and dropping items within the intermediate representation, minimizing, 
maximizing, opening, closing, resizing and moving the intermediate representation (column 4, 
lines 36 - 45; column 5, lines 10 - 19; and column 5, line 63 - column 6, line 43). 



5. 



Claims 5, 32, and 55 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
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Ohkado (US 2001/0047626 Al) and Caviedes (US 6,646673 B2) in view of Taylor et al. (US 
6147773 A). 

As per claim 5, Ohkado and Caviedes sufficiently disclose the method of claim 1 . 

Ohkado and Caviedes do not explicitly disclose that said method further comprises an act 
of, upon automatically reducing the intermediate representation to a reduced representation, 
displaying a message to indicate where the reduced representation is located. 

Nevertheless, in an analogous art, Taylor discloses displaying a message to indicate 
where a reduced representation is located (column 8, lines 39 - 45), wherein an indicator to 
indicate that a window has been reduced to a minimized area is equivalent to a message 
indicating where the reduced window is located. 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
invention to incorporate Taylor's teaching into Ohkado's and Caviedes's invention to display a 
message to indicate where the reduced representation is located upon automatically reducing the 
intermediate representation to a reduced representation. The modification would have been 
obvious, because in Ohkado's invention, the fact that the window is automatically reduced 
without the user implicitly selecting a reduce option would mean that they might not 
immediately know where that the window has been reduced. Therefore, Ohkado would also look 
to Taylor's messaging interface to incorporate Taylor's teaching of indicating such reduction to 
help solve this problem. 

As per claims 32 and 55, and taking into account the rejection of claims 29 and 49, the 

claims are substantially similar to claim 5 and are therefore rejected on the same grounds as 
disclosed in the rejection of claim 5, supra. 
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6. Claims 7, 54, and 57 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ohkado (US 2001/0047626 Al) and Caviedes (US 6,646673 B2) in view of Flowers et al. (US 
2003/0105812 Al). 

As per claim 7, taking into account the rejection of claim 1, Ohkado further discloses 
that the increased level of interaction comprises typing text in the text input box, and wherein the 
enlarge representation comprises a send option ([0035], lines 5-9 and [0028], lines 11 - 17). 

Ohkado and Caviedes do not explicitly disclose that said method further comprises an act 
of automatically reducing the enlarged representation to the intermediate representation upon 
selection of the send option. 

Nevertheless, in an analogous art, Flowers discloses automatically reducing a 
representation upon selection of a send option ([0137], lines 16 - 18). 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
invention to incorporate Flowers 's teaching into Ohkado 's and Caviedes 's invention to 
automatically reduce a representation upon selection of a send option. The modification would 
have been obvious, because upon sending a message, a user most likely has less use for the 
window used to send the message and would therefore want the window to not interfere with 
other windows. Thus, Ohkado would look to Flowers's messaging program and Flowers's 
teaching of automatically reducing a representation of a messaging window upon selection of a 
send option to allow for the messaging window to be reduced to a reduced or closed state and 
thus be out of the way of other windows the user may be using, wherein reducing a window to a 
reduced representation is an obvious variation of closing it entirely. 
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As per claims 54 and 57, Ohkado and Caviedes sufficiently disclose the limitations of 
claims 49 and 52. 

In addition, Ohkado further discloses that the initial representation of the user interface 
comprises the text input box and a send option ([0028], lines 11-17). 

However, Ohkado and Caviedes do not explicitly disclose that reducing the initial 
representation of the user interface is in response to the user selecting the send option. 

Nevertheless, in an analogous art, Flowers discloses automatically reducing a 
representation upon selection of a send option ([0137], lines 16 - 18). 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
invention to incorporate Flowers's teaching into Ohkado's and Caviedes's invention, for the 
same reasons as disclosed in the rejection of claim 7, supra. 

7. Claims 9 - 11 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ohkado 
(US 2001/0047626 Al) and Caviedes (US 6,646673 B2) in view of Quillen et al. (US 
2004/0103156 Al). 

As per claim 9, Ohkado and Caviedes sufficiently disclose the method of claim 8. 

Ohkado and Caviedes do not explicitly disclose that the desktop bar also displays a 
contact representation, the method further comprising an act of, upon dragging and dropping a 
file object onto the contact representation, displaying a real-time message window that includes 
the file object and an option to send the file object to a contact associated with the contact 
representation. 
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Nevertheless, in an analogous art, Quillen discloses a desktop bar displaying a contact 
representation, and upon dragging and dropping a file object onto the contact representation, 
displaying a real-time message window that includes the file object and an option to send the file 
object to a contact associated with the contact representation ([0060] - [0064]). 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
invention to incorporate Quillen's teaching into Ohkado's and Caviedes's invention to display a 
contact representation on a desktop bar, and upon dragging and dropping a file object onto the 
contact representation, displaying a real-time message window that includes the file object and 
an option to send the file object to a contact associated with the contact representation. The 
modification would have been obvious, because Ohkado's chat program is built to improve 
typical chat programs such as Microsoft Netmeeting ([0004]), which supports file transfer. 
Therefore, it would be obvious that Ohkado would want to incorporate relevant improvements in 
the art of chat programs that support file transfer, and would look to Quillen's teaching as a 
means for such improvements. 

As per claim 10, Ohkado, Caviedes, and Quillen sufficiently disclose the method of 
claim 9. In addition, Quillen further discloses an act of highlighting the contact representation 
when one or more real-time messages are received from the contact associated with the contact 
representation ([0070]), wherein the contact currently communicating with the user is contextual 
information that is encompassed by "other contextual information." 

As per claim 11, Ohkado, Caviedes, and Quillen sufficiently disclose the method of 
claim 9. In addition, Quillen further discloses that the contact representation comprises a user- 
definable icon ([0080]). 
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8. Claim 13, 14, 28, 36, 47 and 46 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Ohkado (US 2001/0047626 Al) and Caviedes (US 6,646673 B2) in view of 
Amro (US 5,699,535). 

As per claim 13, Ohkado and Caviedes sufficiently disclose the method of claim 12. 

Ohkado and Caviedes do not explicitly disclose automatically reducing or enlarging the 
one or more representations of the one or more other user interfaces when the intermediate 
representation is automatically enlarged or reduced. 

Nevertheless, in an analogous art, Amro discloses automatically reducing or enlarging 
one or more representations of one or more other user interfaces when the size of a current 
representation is modified (column 2, lines 27 - 44). 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
invention to incorporate Amro's teaching into Ohkado 's and Caviedes 's invention to 
automatically reduce or enlarge the one or more representations of the one or more other user 
interfaces when the intermediate representation is automatically enlarged or reduced. The 
modification would be obvious, because there is a need for an enhanced user interface that 
automatically resizes other interfaces that are not immediately being used so as to allow the user 
to more easily interact with the current interface (Amro, column 2, lines 19 - 21). 

As per claims 28 and 46, and taking into account the rejection of claims 27 and 45, the 

claims are substantially similar to claim 13 and are therefore rejected on the same grounds as 
disclosed in the rejection of claim 13. 
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As per claim 36, taking into account the rejection of claim 29, Ohkado further discloses 
that the intermediate representation of the user interface for real-time communication is 
displayed within a desktop bar, and wherein the desktop bar displays one or more 
representations of one or more other user interfaces simultaneously with the intermediate 
representation of the user interface for real-time communication ([0031] and [0042]), wherein 
the fact that the representation can be displayed on a title bar of an object window means that the 
title bar would also display representations of the other objects, wherein it is inferred that objects 
may comprise interfaces. 

Ohkado and Caviedes do not explicitly disclose automatically reducing or enlarging the 
one or more representations of the one or more other user interfaces when the intermediate 
representation is automatically enlarged or reduced. 

Nevertheless, in an analogous art, Amro discloses automatically reducing or enlarging 
the one or more representations of the one or more other user interfaces when the intermediate 
representation is automatically enlarged or reduced (column 2, lines 27 - 44). 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
invention to incorporate Amro's teaching into Ohkado's and Caviedes's invention for the same 
reasons as disclosed in the rejection of claim 13. 

As per claims 14 and 37, and taking into account the rejection of claims 13 and 36, 
Caviedes further discloses that the one or more other user interfaces comprise one or more of a 
calendar object, a streaming video object, a streaming audio object, and a contact list (column 
5, lines 1 - 9 and lines 28 - 37). 
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9. Claims 15 and 16 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ohkado 
(US 2001/0047626 Al) and Caviedes (US 6,646673 B2) in view of Brown et al. (US 7,146,573 
B2). 

As per claim 15, Ohkado and Caviedes sufficiently disclose the method of claim 1. 

Ohkado and Caviedes do not explicitly disclose that the reduced representation of the 
user interface for real-time communication comprises a selectable icon. 

Nevertheless, in an analogous art, Brown discloses a reduced representation of a user 
interface for real-time communication comprising a selectable icon (Abstract, lines 8 - 9). 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
invention to incorporate Brown's teaching into Ohkado's and Caviedes's invention to include a 
reduced representation of a user interface for real-time communication comprising a selectable 
icon. The modification would be obvious, because both Brown's and Ohkado's inventions 
pertain to the automatic adjusting of interface representations according to user activity. In 
addition, a minimized icon is a well4mown type of minimized representation of an interface and 
would therefore be an obvious type of representation for Ohkado to include in his invention. 

As per claim 16, Ohkado, Caviedes, and Brown sufficiently disclose the method of claim 
15. In addition, Ohkado further discloses that the intermediate representation of the user 
interface for real-time communication is automatically reduced to the reduced representation, 
the method further comprising an act of displaying one or more received real-time messages 
adjacent the reduced representation for at least a predetermined period of time ([0038] - 
[0042]), wherein the linkage of an interface in a minimized state to a title bar including other 
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interface representations would adjacently link said interface in a minimized state to other 
interfaces of the chat program that would most likely comprise other received real-time 
messages. 

10. Claims 33 and 34 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ohkado 
(US 2001/0047626 Al), Caviedes (US 6,646673 B2), and Taylor et al. (US 6,147,773 A) in view 
of Brown et al. (US 7,146,573 B2). 

As per claim 33, Ohkado, Caviedes, and Taylor sufficiently disclose the computer 
program product of claim 32. In addition, Ohkado further discloses displaying one or more 
received real-time messages adjacent a selectable icon for at least a predetermined period of 
time ([0038] - [0042]), wherein the linkage of an interface in a minimized state to a title bar 
including other interface representations would adjacently link said interface in a minimized state 
to other interfaces of the chat program that would most likely comprise other received real-time 
messages. 

Ohkado, Caviedes, and Taylor do not explicitly disclose that the reduced representation 
of the user interface for real-time communication comprises said selectable icon. 

Nevertheless, in an analogous art, Brown discloses a reduced representation of a user 
interface for real-time communication comprising a selectable icon (Abstract, lines 8 - 9). 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
invention to incorporate Brown's teaching into the invention of Ohkado, Caviedes, and Taylor to 
include a reduced representation of a user interface for real-time communication comprising a 
selectable icon. The modification would be obvious, because both Brown's and Caviedes's 
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inventions pertain to the automatic adjusting of interface representations according to user 
activity. In addition, a minimized icon is a well-known type of minimized representation of an 
interface and would therefore be an obvious type of representation for Ohkado to include in his 
invention. 

As per claim 34; Ohkado, Caviedes, Taylor, and Brown sufficiently disclose the 
computer program product of claim 33. In addition, Ohkado further discloses enlarging the 
selectable icon representation of the user interface for real-time communication in response to 
the user interacting with the one or more real-time message displayed adjacent to the selectable 
icon ([0010]). 

11. Claim 56 is rejected under 35 U.S.C. 103(a) as being unpatentable over Ohkado (US 
2001/0047626 Al), Caviedes (US 6,646673 B2), and Taylor et al. (US 6147773 A). 

As per claim 56, Ohkado, Caviedes, and Taylor sufficiently disclose the limitations of 
claim 55. 

Ohkado, Caviedes, and Taylor do not explicitly disclose that the reduced representation 
comprises a conversation balloon. Nevertheless, the use of conversation balloons as reduced 
representations in chat interfaces is well known in the art and would thus be an obvious possible 
means for representing a conversation within the conversation system of the invention of 
Ohkado, Caviedes, and Taylor. 
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Response to Arguments 

12. Applicant's arguments filed on 1/30/2008 have been fully considered, but are moot in 
view of new grounds of rejection. 

Conclusion 

13. It is noted that any citation to specific, pages, columns, lines, or figures in the prior art 
references and any interpretation of the references should not be considered to be limiting in any 
way. A reference is relevant for all it contains and may be relied upon for all that it would have 
reasonably suggested to one having ordinary skill in the art. In re Heck, 699 F.2d 1331, 1332- 
33,216 USPQ 1038, 1039 (Fed. Cir. 1983) (quoting In re Lemelson, 397 F.2d 1006,1009, 158 
USPQ 275,277 (CCPA 1968)). 

14. The prior art made of record and not relied upon is considered pertinent to the applicant's 
disclosure. The cited documents represent the general state of the art. 

15. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Eric A. Wiener whose telephone number is 571-270-1401. The 
examiner can normally be reached on Monday through Thursday from 9am to 5pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Weilun Lo, can be reached on 571-272-4847. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

/Eric A Wiener/ 
Examiner, Art Unit 2179 



/Steven B Theriault/ 

Patent Examiner, Art Unit 2179 



